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ESSENTIALS 
LEARN | CODE | MAKE 


AVAILABLE NOW: | 


> CONQUER THE COMMAND LINE 





> EXPERIMENT WITH SENSE HAT 
> MAKE GAMES WITH PYTHON 

> CODE MUSIC WITH SONIC PI 

> LEARN TO CODE WITH SCRATCH 
> HACK & MAKE IN MINECRAFT 

> ELECTRONICS WITH GPIO ZERO 
> LEARN TO CODE WITH C 

> THE CAMERA MODULE GUIDE 
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AIY PROJECTS 


oogle AIY Projects brings do-it-yourself artificial 

G intelligence (AI) to the maker community. 

AIY Projects is a series of open-source designs that 
demonstrate how easy it is to add AI to your projects. 

We are thrilled to present the very first project, a 
kit that lets you explore voice recognition and natural 
language understanding. 

You will build a cardboard device that uses the Google 
Assistant to answer questions, like “how far away is the 
moone” or “what is 18 percent of 92°”. 

Then you will learn how to add voice commands to your 
own projects. For example, you can register commands, 
such as “turn the lights on” or “robot, turn right and move 
forwards”. In the kit, Google has included a microphone, 

a speaker, and an accessory board called Voice HAT, that is 
loaded with breakout pins to wire up a variety of sensors 
and components. 

Google can’t wait for makers to build intelligent devices 
that solve real-world problems and share them back to the 
community using the #AIYProjects hashtag on social media. 

Your kit is a fantastic way to add voice control to your 
projects, and start exploring what’s possible with AI. 


Lucy Hattersley 


FIND US ONLINE | taspberrypi.org/magpi §GETIN TOUCH Magpi@raspbetrrypi.org 
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| . atural Human Interaction is this idea of being able to 

GMO oO) | ee, communicate with an electronic device the same way you and 
a £ es S55 vs i ase I are talking right now,” says Billy Rutledge, Director of AIY 

| St ashe Se Projects at Google. We’ve caught up at Raspberry Pi Towers to discuss 
the ATY Projects kit, and the future of artificial intelligence with the 
maker community. 

“We’re all familiar with graphical user interfaces (GUI)”’, notes Billy. 
“Well, building a VUI is now the big thing.” Voice has become “very 
popular” in the last year, says Billy. “Not just with consumer products, 
but also as a set of tools for device makers.” 

Google wants to help makers familiarise themselves with voice 
interfaces, but it’s also really keen to tap into the creative prowess 
of the maker community. 

“We’re excited to put the kits out into the world and see what 
people make with them,” says Kristine Kohlhepp, a User Experience 
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Researcher working on AIY Projects at Google. “We’ve done a lot of 





research to make sure people can assemble the kit and figure out how 
to make it work.” 

“The initial project is just an opener,” reveals Blaise Aguera y Arcas, 
Principal Scientist at Google. “It’s fun to be able to make a cardboard 
kit that uses the Google Assistant, but this is about a lot more than just 
making a lower-cost DIY version of Home.” 

The future belongs to intelligent devices. Billy says: “At some 
point soon, we’ll see a new generation of devices that you can just 
walk up to and ask ‘what are you and what do you do°’ Then you’ ll 
have a conversation with it, to use its services in a very easy-to- 
understand way.” 

Natural Human Interaction is the term used for this kind of interaction 
between humans and devices. “A generation or two ago, all of our devices 
















[ AlY PROJECTS ] 


had analogue dials and knobs,” explains Billy. “Then there was a shift 
to digital buttons and displays. Now we are moving to a human interface 
where you simply have a conversation with the device.” 

It’s also important to ease people into Al as part of their natural 
interaction with electronic devices, alongside touching buttons and 
screens. “We can easily become distracted by personification of these 
kinds of systems,” says Blaise. 

It’s important for makers to realise that VUIs are something they can 
create, and use, in their projects. “I think letting the makers see how 
easy it is to put Al, specifically Natural Human Interaction capabilities, 
into their projects will be a great thing,” says Kristine. 

“We want to show you how easy it is to use Al, and then share back 
with us to inspire new project ideas and keep the whole cycle going,” 
Kristine continues. 


We want to show you 
how easy it 1s to use Al 


“My top-secret plan is to build more engineers,” discloses James 
McLurkin, Senior Hardware Engineer of AIY Projects at Google. 
“Getting kits like this out into the world with Raspberry Pi allows us to 
build the things that then create more engineers.” AIY Projects enables 
young makers to explore the possibilities with AI. “So this is very 
exciting for us,” says James. 

“What’s interesting about the maker environment is what happens 
when we shut up, and listen, and see what people try,” says Blaise. 
Historically, there have been many ‘Hello World’ types of starter 
projects for various programming languages and platforms, and in 
recent years we’ve seen exciting new hardware like the Raspberry 
Pi emerge. Now there is AI, another technology for makers and 
developers to add to their projects. AIY Projects brings these three 
things together, which will be “super interesting,” reckons Blaise. 


“T don’t know what will come out from the mixture of those, but I’m [ a 
very keen to see.” 


“T view this as an essential component in a maker’s toolkit,” Billy 
tells us. “We want makers to see that using Al is not hard or complex.” 
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The Voice 
HAT hardware 


The Australian artist Stelarc has said that technology constructs our 
human nature. “We would not be who we are if we hadn’t invented 
fire and woven clothes and built Raspberry Pis,” says Blaise. “That 
is what being human is all about, and that’s what distinguishes us 
from the other animals. So I don’t like this idea that talks about AI as 
a competitive landscape of human exceptionalism, and ways that it is 
being eroded. That really misses the point of what all this is about.” 

“This first kit showcasing voice is just the start of our effort to bring 
Google AI to the maker community,” reveals Billy. “Our projects will 
largely focus on Natural Human Interaction.” Following voice, we 
intend to feature projects with vision, motion, and learning.” 

Google wants makers to add AI to their own projects, and share their 
results with others. “We want to learn what this community needs,” 
says Billy, “and then work with them to build the tools they want.”’ 
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nside the kit will be the 

components you need 

to build a voice-capable 
device with Raspberry Pi. 

Open the box and you’1l find 
two pieces of cardboard, an 
aia st ie DLITOT dis Dedicate 
and some cables, along witha 
HAT (Hardware Attached on Top) 
board and another narrower 
board. One is to connect all the 
BICC SSNCnlSs olxeldaein, ile Olan ein 
ica tere MIciop mene 

All of these components fit 
together to build the AIY Projects 
kit: a small cardboard device with 
a colourful button on the lid. You 
press the button, or clap your hands 
(or create a custom trigger), and 
speak out loud to ask the device a 
question. The speaker, at the front, 
then announces the answer. 

Use the Bill Of Materials 
list below to check you have 


\ alli the components. 
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ith all your parts ready, it’s time to build the AIY Projects 

voice kit. The aim is to assemble all the included parts (anda 

Raspberry Pi board) and create a small cardboard device with 
a button on top. 

This project is a relatively easy build, and you won’t need to solder 
any of the components. Be careful to line up the wires correctly, 
especially the wires for the button. It’s also a good idea to take 
a close look at the Voice HAT accessory board (the larger board). 

The Voice HAT is the heart of the AIY Projects kit, and everything 
connects to it. It also provides breakout GPIO pins, organised into 
two blocks: Servos and Drivers. 

You'll connect the Voice HAT accessory board to your Raspberry 
Pi via the GPIO pins. The Raspberry Pi is the brains of the outfit: 
it connects to Google’s cloud services through a local Python 
application. The Python source code is provided with the software 
image, as well as on GitHub. 
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Also take a close look at the smaller microphone board, which 
enables the device to hear you speak. 

But first, we need to get it all assembled. The first step is to 
mount the Voice HAT accessory board to your Raspberry Pi, and 
then connect the speaker and microphone. Then you’ll move on 
to folding the cardboard case and placing the components inside. 
Finally, you’ll assemble the arcade-style button and secure it 
(and the microphone) to the case. 

Ready? Let’s start building your kit. 


Start with the two standoffs. These are the small plastic cylinders, and 
they fit into the yellow mount holes on the Raspberry Pi board. Insert the 
standoffs into the two yellow holes on the opposite side from the 40-pin 
GPIO header (on the same side as the HDMI connection). Push them firmly, 
and they will hold in place. 
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Take a close look at the Voice HAT accessory board and find the blue 





terminal with two small screws. This terminal is the speaker connection (it has 
‘Speakers’ printed above it on the board). Each of the two connections has a 
small ‘+’ and ‘-’ symbol printed below. Find the speaker with the red and black 
wires attached. Insert the red wire into the positive ‘+’ terminal on the Voice 
HAT accessory board. Now add the black wire into the negative ‘-’ terminal. 
They won't be fixed yet, so hold them in place. 
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Find the Voice HAT microphone board and 
the 5-wire daughter board cable. The cable 
has matching white plugs on either end. Both 


ends of the cable are identical, so take either 


7 
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ye SPN 


end of the 5-wire connector cable and slot 


. 


it into the Voice HAT microphone board. 
£2 It will only fit one way around. Snap 
rh o>, the cable in, but don't force it. 
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Do the same for the other folds, tucking 


FOLD 4 underneath to secure it in place. 
Now set it aside. 








Find the other cardboard piece that came with your kit 
(as shown in the picture). This piece will build the inner 
frame to hold the hardware. Fold the flaps labelled 1 
and 2 along the creases. 


Find your speaker 
(which is now attached 
to your Raspberry Pi 3). 
Slide the speaker into 
the U-shaped pocket 


on the cardboard frame. 
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Turn the cardboard frame around. Take the Pi + Voice HAT hardware and 
push it into the bottom of the frame below flaps 1 and 2 (pictured). The 
cardboard frame should expose the USB ports of the Raspberry Pi. 
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& CHECK THE WIRES 


Once it’s in, the Raspberry Pi should be 
Jind] ale melal dalom ofe)ake)agme)maal-m ele) em iy cli<a) 
sure your wires are still connected. 
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Check the holes in the 
cardboard box. The Raspberry 
Pi ports should be clearly visible. 













Insert the plastic button into the 
top flap of the cardboard box from 
the outside in. The pushable button 
side should face outward, with the 
larger screw on the inside; i.e. the 
side marked ‘BUTTON: 
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Locate the four coloured wires with metal 
contacts that you previously connected 
using the crown logo. The blue and 

red wires should be attached to pins 
embedded in red plastic (or the colour 

of your button). The white and black 
wires are attached to the pins 
protruding from grey plastic. 


Or 
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Download and set up the AIY Projects software 
-and connect your device to the internet 
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ou now have a fully assembled cardboard device that is 
almost ready to respond to your questions. Now that your box 
is assembled, we will begin the process of turning it into a 
Voice Assistant, and an intelligent voice-powered interface for your 
own projects. 
To do this, you’ll set up a Google Developer project and activate 
the brand-new Google Assistant SDK. 
But first, you need the base to work with. And that’s a custom 
operating system designed especially for the AIY Projects kit. 
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>STEP 01 

Download image 

First, you need to download the AIY Projects image from magpi. 
cc/2x7JQFS. Please check the website for any updates to this process. 
ATY Projects software is routinely updated. Click the Get the Voice Kit 
SD Image link. The image file is saved to your Downloads folder. 


>STEP 02 
Copy image 
Burn the image to a microSD card using a program like Etcher 
(etcher.io) on a Mac, Windows, or Linux computer. 

Etcher software copies the image to the SD card (see ‘Burn SD cards 
with Etcher’, magpi.cc/2fZkyJD, if you’re unfamiliar with the process). 


>STEP 03 

Plug in peripherals 

Now that your box is assembled, plug your peripherals in: 
1 USB keyboard 
2 USB mouse 
3 HDMI monitor 





>STEP 04 

Insert SD card 

Insert your SD card (the one with the Voice Kit SD image) into the slot 
on the bottom side of the Raspberry Pi board. The SD card slot should 
be accessible through a cutout provided in the external cardboard form. 
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With the microSD card inserted into the Raspberry Pi, and the 
peripherals (monitor, keyboard, and mouse) connected, plug in the 
power supply. The Raspberry Pi will begin booting up, and you should 
see the AIY Projects desktop. 
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>STEP 06 

Check LED lights 

Once booted, the small LED in the centre of the Voice HAT and the 
LED inside the arcade button should both indicate the device is 
running.If you have any problems booting, check the troubleshooting 
cuide in the appendix. If you don’t see anything on your monitor, or 
you see ‘Openbox Syntax Error’, check the troubleshooting guide at 
the end. 


>STEP 07 

Connect to network 

Click the network icon in the upper right corner of the Raspberry 
Pi desktop. Choose your preferred wireless access point. Enter the 
wireless LAN password in the Pre Shared Key box and click OK. 





>STEP 08 
Check network 
Double-click the Check WiFi icon on your desktop. This script 
verifies that your WiFi is configured and working properly on the 
Raspberry Pi board. 

If everything is working correctly, you’ ll see a confirmation message. 
Press ENTER to close. 


>STEP 09 

Check speaker 

Double-click the Check Audio icon on your desktop. This script verifies 
the audio input and output components on the Voice HAT accessory 
board are working correctly. 
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Say “Testing, 1 2 3” out loud. It will play back your voice with the 
message ‘Did you hear your own voice (y/n)’. Again, enter y and press 
ENTER. Press ENTER again to end the test. 

If you see an error message, follow the message details to resolve the 
issue and try again. 
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ongratulations on assembling your voice recognizer 
device — now, let’s bring it to life! We’ re going to build 
a voice recognizer that uses Google Assistant, much like 
Google Home. 

The voice recognizer uses the Google Assistant SDK to recognise 
speech, along with a local Python application that evaluates 
local commands. 

Your voice recognizer will let you talk to the Google Assistant, 
and it will respond with smart answers to your questions. 


>STEP O01 

Google Cloud Platform 

To try the Google Assistant API, you need to first sign into Google Cloud 
Platform (GCP) and then enable the API. 





US MVol Ul al Crelole|K=w-(exorolulal mkon-J(elamlamcomal-merolele| (-me@ilolb(oM mt-ince)qaar 


iio) me (ola mal=\Vi-me)al-Mavcole ml mal-{-(oM KoMelg-r-1k-melal-mm Mavilavemaal-merelele |= 


Assistant API is free to use for personal use. 





>STEP 02 

Log into GCP 

Using ATY Projects on your voice recognizer device, open up the 
Chromium web browser (click on the blue globe icon in the top bar of 
the desktop). Go to the Cloud Console (console.cloud.google.com). 
Enter your Google account ID and password. 


>STEP 03 

Create a project 

GCP uses projects to organise things, so you’ ll need to create a new 
project for your AIY Voice Kit. In Cloud Console, click the drop-down 
button to the right of the Google Cloud Platform logo (in the top-left 
of the screen). Now choose Create Project. 
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>STEP 04 

Name the project 

Enter a project name, such as ‘Voice 
Assistant’ and click Create. After your project 
is created, make sure the drop-down has 
your new project name displayed (if not, click 
on it and choose it from the list of projects). 


>STEP 05 
Turn on the API 
Click Product & Services (the triple line 
icon) in the top-left of the GCP. Choose 
APIs & services and Dashboard and click 
Enable APIs. 

Enter ‘Google Assistant API’ into the 
Search box and click it from the list below. 
Now click Enable. 


>STEP 06 

Create credentials 

In the Cloud Console, create an OAuth 
2.0 client by going to APIs & Services > 
Credentials. 

Click on ‘Create credentials’ and choose 
OAuth client ID. 

If this is your first time creating a client ID, 
you’ll need to configure your consent screen. 
Click ‘Configure consent screen’. Enter a 
Product Name, such as Voice Assistant. 

Click Save. 


>STEP 07 

Name credentials 

Select Other. It will have the default name 
‘Other client 1’. Change the name to ‘Voice 
Recognizer’ to help you remember the 
credentials. Click Create. 
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>STEP 08 

Client ID and secret 

A window will pop up, named ‘OAuth client’, 
with ‘Here is your client ID’ and ‘Here is your 
client secret’. Don’t worry about memorising 
the long numbers, just click OK. 


>STEP 09 

Download JSON 

In the Credentials list, find your new 
credentials and click the Download JSON icon. 
If you don’t see the download icon, try expanding the width of your 
browser window or zooming out (CTRL+—). A JSON file starting with 
‘client_secrets’ is saved to your Downloads folder. 


>STEP 10 
Find credentials 
Open a Terminal window (click Terminal in the taskbar) and enter: 


Ten Connoke Chowe gmagie com 


cd Downloads 
ls 


...to view the client secret file. It will havea lot of numbers and end 
with .json. 


>STEP 11 

Rename the credentials 
You need to rename the file to meme File Edit Tabs Help 
assistant.json and move it to your 
home directory. Enter: 





fe) oe 


pi@raspberrypi: ~/Downloads 


mv client_secret 


...and press the TAB key. This will 
fill out the rest of the letters in the 
file. Now add /home/pi/assistant. 
json to the end of the file and 
press ENTER. 








This is how the full command looks on our AIY 


android things | Projects voice recognizer (your client secret file 


will be different): 





Return to Chromium and visit your Google 
Activity Controls at myaccount.google.com/ 
activitycontrols. Make sure to log in with the same 
Google account as before. 
Turn on the following by ticking the slider to the 

right, so they appear blue: 

Web and app activity. Make sure the ‘Include 

Chrome browsing history and activity from 

websites and apps that use Google services’ 

checkbox is ticked). 

Device information 

Voice and audio activity 


Device information 


Store your Comtacts. CakenGark apps anc OTs Gevece Gata to Imprort you expenence 


ecross Googie. Find oul more 


MANAGE ACTIVITY 





hi Ne Bais Le Mak RAIN 





Double-click the ‘Start dev terminal’ icon and enter: 





A ‘Request for Permission’ window appears. Click Allow and close 
the web browser window. Return to the terminal window and you will 
see ‘Say “OK, Google” then speak, or press Ctrl+C to quit...’ 


In the Assistant Library demo, you can use the AIY Projects kit as a 
voice assistant. Say “OK Google” and ask a question out loud, such as 
“what is the weather in Cambridge°”. Press CTRL+C when you’re done. 

Google provides three demo apps that showcase voice recognition 
and Google Assistant with different capabilities. They may be used as 
templates to create your own apps. 
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y now, you have built a device that embeds the Google a Be Se 
Assistant. That’s cool, but it’s just the beginning. With Le : 4 Ss és 
Google Cloud Speech API, you can create an interactive, hs 5a ee —— 
custom voice-user interface (VUI) for your project. ee he ae oe af 
This enables you to explore a new generation of devices that you can kgs ee ee 
have a conversation with, without the need for remote-control devices CC Se 
(such as joysticks or smartphone apps). Let’s reconfigure the kit to use ir pies RCA EAN 
the Google Cloud Speech API. ¥ sr eee ah ga f:3 
We MN 
eas 
The source code for the voice recognizer app is part of the image that | aU | Fe 
you ve just installed. You can view the Python source code in the ae oe vey 
/home/pi/AIY-voice-kit-python/src directory. Alternately, the a ys 
project source is available on GitHub: github.com/google/aiyprojects- ey 2 
raspbian/tree/voicekit. It is released under the ‘voicekit’ branch. . wig 
Pa 


Head to Google Cloud Console in the browser and click Create 
Credentials. This time choose ‘Service account key’. 
Click the ‘Service account’ menu and 
choose ‘New service account’. Give it 
a name, such as ‘AITY Projects’, and 
change the Role to Project > viewer. 
Make sure the Key type is JSON and 
click Create. The key is downloaded 
to your computer. 








Find the file you’ve downloaded. 
You need to rename the file to 
cloud_speech.json and place it in your 
home folder. 





You need to have the 

Cloud Speech API enabled 

to use the service. In 

Cloud Console, go to API 

& Services > Library. Click 

on Speech API and click 

Enable (then follow the prompts 
to set up a billing account, or 
follow the instructions in step 6, 
then click Enable again). 


You need to have billing set up 

with Google to use the Cloud 
Speech API. Open Cloud Console, click ‘New billing account’ and go 
through the setup. Check your project is selected in the Projects menu 
at the top. Click Products & Services > Billing. To connect or change 
the billing account, click the three-dot button, then select ‘Change 
billing account’. 
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pi@raspberrypi: ~ 








On your desktop, double-click the Check Cloud icon. Follow along with ie 
the script. If everything is working correctly, you’ ll see this message: ; 
‘The cloud connection seems to be working.’ 

If you see an error message, try restarting your Raspberry Pi with 
sudo reboot. Then follow the instructions above, or take a look at the 
instructions on the AIY Projects page (magpi.cc/2q5SSF7). 





Open ‘Start dev terminal’ and enter: 


You can now issue a limited number of commands: 
Turn on the light (turns on the LED on the Voice HAT). 
Turn off the light (turns off the LED). 
Blink (the LED blinks). 
Goodbye (the program exits). 
Press CTRL+C to quit the interaction. 
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>STEP 08 

Create a new activation trigger 

An activation trigger is a general term describing the condition on 
which we activate voice recognition or start a conversation with the 
Google Assistant. Previously you have seen two different types of 
activation triggers: 


¢ Voice activation trigger: This is the “Okay, Google” hotword 
detection in the assistant library demo. 
¢ Button trigger: This is when you press the arcade button. 


You may design and implement your own triggers. For example, 


—— i | you may have a motion detection sensor driver that can call a function 
when motion is detected: 


@ 
moitton.py 
import aiy.audio 


import aiy.cloudspeech 
import aiy.voice 


def main(): 
""'Start voice recognition when motion is detected.''' 
my motion detector = MotionDetector() 
recognizer = aiy.cloudspeech.get_recognizer() 
aiy.audio.get_recorder().start() 
while True: 

my motion _detector.WaitForMotion() 

text = recognizer.recognize() 

aiy.audio.say('You said ', text) 
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ow that you’ve switched from the Assistant SDK to the Cloud 
Speech API, you’ll want to know what you can do with it. You 
add custom commands to your own Python files. 

There is a selection of example voice commands located in 
cloudspeech_demo.py. We’re going to modify this file to see how 
they work, then create our own Python programs to control circuit 
components attached to the Voice HAT. 


TV 
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>STEP 01 

Backup first 

You can create new actions and link them to new voice commands by 
modifying src/cloudspeech_demo.py directly. First, backup the file: 


cp src/cloudspeech_demo.py src/cloudspeech_demo_backup. py 
Open the cloud speech demo using 


nano src/cloudspeech_demo.py 


>STEP 02 
Expect phrase 
To add a custom voice command, you first have to make it explicit 
what command is expected to the recognizer. This improves the 
recognition rate. 

We’re going to add a new recognizer.expect_phrase method to the 
cloudspeech_demo. py code: 


recognizer.expect_phrase('repeat after me') 


The program now expects to hear “repeat after me” along with the 
other commands. 


>STEP 03 
Handle phrase 


Next we add the code to handle the command. We will use aly.audio.say 
to repeat the recognized transcript. 


elif ‘repeat after me’ in text: 
to repeat = text.replace('repeat after me', '', 1) 
aiy.audio.say(to_repeat) 


You’ ll find the full modified code in the cloudspeech_demo.py 
code listing. Use src/cloudspeech_demo.py to run the modified 
program. Now press the button and say ‘repeat after me 1, 2, 3’ the AIY 
Projects voice kit should say ‘1, 2, 3’. 
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cloudapeech_demo py 


A demo of the Google CloudSpeech recognizer. 
oy 
Q3. 
Q4. 
Q5. 
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import os 


import aiy.audio 
import aiy.cloudspeech 
import aiy.voicehat 


def main(): 


if 


recogniz 
recogniz 
recogniz 
recogniz 
recogniz 


button = 


led = aiy.voicehat.get_led() 


aly.audi 


while Tr 


print('Press the button and speak’ ) 


butt 
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er = aiy.cloudspeech.get_recognizer() 
er.expect_phrase('turn off the light’) 
er.expect_phrase('turn on the light') 
er.expect_phrase( ‘blink’ ) 
er.expect_phrase('repeat after me') 
aiy.voicehat.get_button() 
o.get_recorder().start() 


ue: 


on.wait_for_press() 


print('Listening...') 


text = 


1s 


recognizer.recognize() 
ext is None: 
print('Sorry, I did not hear you.') 


else: 


__name__ 


main() 


print('You said "', text, '"') 
if ‘turn on the light’ in text: 
led.set_ state(aiy.voicehat.LED.ON) 
elif ‘turn off the light' in text: 
led.set_ state(aiy.voicehat.LED.OFF ) 
elif ‘blink’ in text: 
led.set state(aiy.voicehat.LED.BLINK) 
elif ‘repeat after me' in text: 
to repeat = text.replace('repeat after me', '', 1) 
aiy.audio.say(to_repeat) 
elif ‘goodbye’ in text: 
os. exit(@) 


__main__ 
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ere pi@raspberrypi: ~/AlY-voice-kit-pythor | >STEP O04 
Control an LED 
Now that we can add custom commands, 
we’re going to use the ATY Projects kit 
to control some hardware. Set up an 
LED circuit using a breadboard - follow 
the diagram shown on page 58. We are 
connecting the LED via the pins on 
Servo 0. Connect the live wire to Pin (on 
the left). This is GPIO 26 using the BCM 
"ees dak numbering system. Connect the ground wire to GND (on the right). 
assistant. This short The middle pin provides a constant 5V of power. You can see the 
program turns an LED : ' ; 
light onoroff reference for each pin underneath the Servo 5 rail (check the diagram 
in ‘Voice HAT hardware extensions’ at the back of this book). 
We have found that it will work by connecting wires directly to the 
through-holes on the board. For a more reliable circuit, carefully solder 


the pins supplied with your Voice HAT. 


>STEP 05 

Enter LED code 

Create a new file using nano src/led_demo.py and enter the code from 
the led_demo.py listing. Notice the first line: #!/usr/bin/env python3. 
This enables you to run this code from the command line. 


>STEP 06 
Run the code 
We need to make the file executable to run it from the command line. 
















Ai ieres dae chmod +x /src/led_demo.py 
VOICE RECORDER 


If you get a message that says: “Server error: 

Audio data is being streamed too slowly src/led_demo.py 

or too quickly. Please stream audio data 

approximately at real time.” Then you've Press the button and say “turn on 

ice) ge(olak-lamcomelqame)amial-m(e)(a-ma-lee)ce(=) @ the light”. The LED on your breadboard 
aliy.audio.get_recorder().start() lights up; say “turn off the light” 


ee rast ag to switch it off. 
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Now run the code using: 
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led_demo.py 


#!/usr/bin/env python3 


import aiy.audio 

import aiy.cloudspeech 
import aiy.voicehat 
import RP1i.GPIO as GPIO 





def main(): 
recognizer = aiy.cloudspeech.get_recognizer() 
recognizer.expect_phrase('turn on the light") 
recognizer.expect_phrase('turn off the light") 


button = aiy.voicehat.get_button() 
aiy.audio.get_recorder().start() 


GPIO.setmode(GPIO.BCM) 
GPIO.setwarnings(False) 
GPIO.setup(26,GPIO.OUT) 


while True: 
print('Press the button and speak") 
button.wait_for_press() 
print('Listening...') 
text = recognizer.recognize() 
if text is None: 
print('Sorry, I did not hear you.') 
else: 
print('You said "', text, '"") 
if ‘turn on the light’ in text: 
GPIO. output (26,GPIO.HIGH) 
elif ‘turn off the light’ in text: 
GPIO. output (26,GPIO.LOW) 
if name == '_main_': 
main() 
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SET UP AN LED CIRCUIT 
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Connect the live wire to GPIO 26, 
the leftmost pin on Servo Oo, and 


(Oro) a] at =re1 m= 1a m=] D Kod Wal-me)c=1-(eleler-ice| 
and create a circuit (with the longer leg 
oxo) alatqreakqro Rte i\V ome laromtal-B-ialelakcia lave dal=mUNVom ell ela mtal=me)a-r-leleley-lcee 


Y=1om Wal= MC] od (OM c-\rolelmelul(e(-mace)aa| 


fore) alal=rei Kore M Keke] cole lale) mm Dlo)ahmce)ce(-1mKonUl ee) 


Rass} is} Ko) m(slgelelare Bc kciOMe)alaaym con o)ge)k-.elmaai=m mai D) dal=m o)cnV(eletom orale (-mcelmelel(et=larer=) 





ee ee 


(Oo) alal=reimdal-me|colelacoMuaico muon nal) 


©} DM oyiaKe)amial-eei-)aVomen c-le-lare| 
ival=melcolulalem g-\|melamtal-m e)¢-r-\e|eler-\ce| 










eee eoeen#eeeee#ee#eioeee#*e#e#eeee#ee#e#ee#e#eee#e#ee#e#es##8eee#e#e#e 
eee @o«oeoeeeee#ee#eeoeeeeee#ee#eeoge8teee#e#eeee#ee#e 








Voice HAT @ =o 





SHSHSHSHSSHOSSSCHSESHHESHSHEAES 


eee e*eee *aeeee#ee#e#foeee#e#e#e#e#eeesge$e##e##e#e#e# 
eeeeee#@ee#ees85s4see#eee#e#ee2eueee#eeee#e# 
ee ewe oe«eonee#eee#@ee#ee#eeee#e#e#eee#eee#ee#ee#e# 
eee eoeee#ee#seeeesee*eee*ee#@e##ee#eee#ee#see#e# 
eee eoeee#ee#eee#e#s2eoeee#ee#e#e#en5ee#eeee#e# 
eee e@*ee#ee#eeee##ee#e#eee#efeeesgseee#e#ee#e# 








[ AlY PROJECTS ] 


SAFE SHUTDOWN 


One script that's well worth knowing is shutdown. This will safely 

00 (ga meyim’(olel@AUh Madge) (-leit-m (imam Malom—ialUixe (eo) /iame(-lsa lon oh mocole(=MOIiosomaal=) 
10] 0) e)celer=1-i-m galole ide |K-mnomaulam- Mellie (ey Zamelaly@ece)aalaat-larommel (aa) el Waste NY 
i) aluime(o\\ Za Macomielaame)imicelel@alh Mnige)(-\el ka im 


shuldown_demo.py 


#!/usr/bin/env python3 


import aiy.audio 
import aiy.cloudspeech 
import aiy.voicehat 
import subprocess 


def main(): 
recognizer = aiy.cloudspeech.get recognizer() 
recognizer.expect_phrase( ‘shutdown’ ) 


button = aiy.voicehat.get button() 
aiy.audio.get recorder().start() 


while True: 
print('Press the button and speak’) 
button.wait_for_press() 
print('Listening...') 
text = recognizer.recognize() 
if text is None: 
print('Sorry, I did not hear you.') 
else: 
Drink Yousaid ““; text, “= ~) 
if ‘shutdown’ in text: 
subprocess.call(["sudo", "shutdown", "-h", "now"]) 
if name == '_main_': 
main() 











“Servo motors are used to perform fine motor 
functions, and with ALY Projects youcan 
_ program fer fOr voice activation i 
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ne of the big hopes for AIY Projects is that Raspberry Pi 
owners will integrate the kit into their own projects. In our 
last tutorial for AIY Projects, we looked at hooking up the 
hardware to control an LED light (a typical first hardware project). 
Here, we’re going to take things up a notch and hook up a Servo to 
the AIY Projects board. 
On the Voice HAT hardware you will see two columns of pins. 
The one on the left (marked Servos) is for servos, and has a 25 mA 
drive limit. The one on the right, marked Drivers, is typically used 
for motors and has a500 mA limit. You can connect wires directly 
to the Voice HAT hardware, but it’s easier to prototype your circuits 
by soldering the pins (supplied with the kit) to the board. 
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CS OO NASON eskoe eels §=Servo motors 


Servo motors move in a circular 


TaVceUme Colaba ant-lat-\e(-mcoe(-1m alollo Kol #-laW DA ce) (=e <8 motion to a set position. They 
fo (oy ah mo) aVaeem €Lofole | K-Walo)el=\-m rol at-\Viom aale) ¢-6-\/-l | Fale) k= are often used to control robotic 
soon. Sign up for our newsletter, and we'll let you arms and legs, grippers, and 


know when more AlY Projects Voice Kits are available: the position of surfaces (like 
magpi.cc/Email-me elevators and rudders on 


an RC plane). 

It is relatively easy to hook 
up a servo motor to a Raspberry Pi, but the AIY Projects Voice HAT 
board makes it even easier, with a dedicated column of pins designed 
to control servo motors. Connecting your servos using the Voice HAT 
allows them to be controlled using voice commands and the Cloud 
Speech API. 


>STEP 02 

Servo control 

Servo motors are controlled using pulses generated by a GPIO pin on 
the Raspberry Pi (we’re using GPIO 26 on the AIY Projects Voice HAT 
board). The servo motor expects a pulse (the GPIO pin to be turned 
on, or high, and then off again) every 20 milliseconds. The length of 
the pulse determines the position of the servo arm. If it’s 1 ms then 
the servo arm is rotated towards the left; 1.5 ms puts it at the mid- 
point; 2 ms and it’s all the way to the right. The code for detecting 
these pulses and moving the servo around is provided with the GPIO 
Zero library. Install using: 






















sudo apt install python3-gpiozero 


>STEP 03 

Connect the servo 

We’re using a standard 9 g micro servo in this tutorial. These are tiny 
5 V servos with an operating voltage of 4.8 V. Each servo comes with 
three wires: usually these are red, brown, and orange. Red and brown 
provide power to the servo, and are live and neutral respectively, 
while the third wire detects the pulse. Make sure your Raspberry Pi is 
powered down, and connect the servo wires directly to the Servos 0 
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The 5 V running through the GPIO pins on the Raspberry Pi is enough 
to power two to three very small servo motors. We’re only using one 
here in our tutorial, so we aren’t going to add additional power. 


Before coding the servo to respond to your voice commands, you can 
test the circuit using GPIO Zero in Python. Open IDLE 3 and enter the 
code from servo_test.py. Save the code and press F5 to run it. The 
servo will move from its minimum position to the mid-point, and 
then to the maximum position with a pause between each step. Press 
CTRL+tC to quit the program and stop the movement. If the servo 
doesn’t work, double-check your connections. 





Now that the servo is working, it’s time to integrate it with the 
AIY Projects code using the servo_demo.py script. Open Start dev 
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Right: A servo motor 
measures the length 
between pulses (a 
GPIO pin being turned 
rapidly on and off). 
When the pin is on for 
1 ms, the servo moves 
to the Low position. 
When it's on for 2 ms, 
it moves to the high 
position. Other pulse 
lengths are used to 
set it between low 
and high 








lms 1.5ms 2ms 


terminal and use nano src/servo_demo.py to create the empty text 
file. Don’t forget to use chmod +x src/servo_demo.py afterwards to 
make it executable. 

Run src/servo_demo.py and press the button on your AIY Projects 
Voice HAT board. Now say “change to minimum” or “change to 
maximum” to move the arm up and down. Saying “change” and any 
other command moves the arm back to the middle. 

Now everything is working, you can attach the servo to the side 
of the kit’s cardboard box. On the side of the kit, you’1] see an arc- 
shaped hole. Most small servos will fit in this space. Twist the servo 
to lock it in place. Try adding a wooden or 3D-printed arm to the servo 
so you can clearly see it moving. 


servo _test.py 


from gpiozero import Servo 
from time import sleep 


servo = Servo(26) 


while True: 
servo.min() 
sleep(1) 
servo.mid() 
sleep(1) 
servo.imax() 





Ree E 


sleep(1) 


server_demo.py 


#!/usr/bin/env python3 
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import aiy.audio 7 Zz 


import aiy.cloudspeech 
import aiy.voicehat 
from gpiozero import Servo 


def main(): 


recognizer = aiy.cloudspeech.get recognizer() 
recognizer.expect_phrase('maximum' ) 
recognizer.expect_phrase( ‘minimum’ ) 
recognizer.expect_phrase('middle' ) 


button 


aiy.voicehat.get_button() 


aiy.audio.get _recorder().start() 


servo = 


Servo(26) 


while True: 
print('Press the button and speak' ) 
button.wait_for_press() 
print('Listening...') 
text = recognizer.recognize() 
if text is None: 


print('Sorry, I did not hear you.'") 


else: 


if _name__ 
main() 


Deane You said. text, 9") 

if ‘maximum’ in text: 
print('Moving servo to maximum’ ) 
servo.max() 

elif ‘minimum’ in text: 
print('Moving servo to minimum’ ) 
servo.min() 


elif ‘middle’ in text: a - 7 
print('Moving servo to middle’ ) 


servo.mid() 
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n our previous AIY Projects tutorials, we’ve looked at how to 
move beyond using the Voice Assistant, and towards using your 
Voice HAT with basic electronics. 

If you’ve been following our tutorials, you will have discovered how to 
connect the Voice HAT hardware to simple circuits. So far we’ve looked at 
how to control LED lights and servo motors, but in this tutorial we’ll look 
at something a little more complex: using the AIY Projects Voice HAT to 
control a motor. 
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[ AlY PROJECTS ] 


>STEP 01 
Cut the power 
The first thing you need to do is isolate the Raspberry Pi’s power supply 
from the power on the Voice HAT board. This will prevent the DC motor 
from draining too much power and shorting out your Raspberry Pi. Locate 
the external power solder jumper marked JP1 (just to the left of Servos 5 
on the Voice HAT board). Use a utility knife to cut the connection in the 
jumper (you can always re-solder this joint if you wish to share the power 
between the board and the motor again). 


>STEP 02 

Power off 

Make sure your Raspberry Pi and Voice HAT board are powered off. Now 
connect the positive leg of the DC motor to the middle pin on Drivers o. 
Notice that at the bottom of the Driver pins is a ‘+’ symbol. 


>STEP 03 
Wire for power 


Next, connect the negative wire of the motor to the ‘-’ pin on Drivers o 
(the pin on the right). You may have noticed that we’re not connected to 


motor_test.py 


from gpiozero import PWMOutputDevice 
from time import sleep 


pwm = PWMOutputDevice(4) 
while True: 
pwm.on() 
sleep(1) 
pwm.off() 
sleep(1) 
pwm.value = @.5 
sleep(1) 
pwm.value = 0.0 
sleep(1) 
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the GPIO Pin on the left (which is GPIO4); this doesn’t matter as it also 
controls the negative ‘-’ pin that we have just connected to. This allows 
us to turn the motor on and off. 


>STEP 04 


Power up 

Finally, connect the 4xAA battery pack to the +Volts and GND pins at the 
lower left-hand corner of the Voice HAT. This pack will ensure that the 
motor has enough power when you are using the Voice HAT, which will 
prevent your Raspberry Pi from crashing. Connect the power and turn on 
the battery pack. 


>STEP 05 

Turn on the Pi 

Now turn on the Raspberry Pi and boot into the AIY Projects software. 
Enter the code from motor_test.py to test the circuit. We are using 
PWMOutputDevice from GPIO Zero to control the motor. This enables us 
to manage the speed of the motor (magpi.cc/2tnAGrz). We can use the 
.on() and .off() methods to start and stop our motor. Alternatively, 
we can set the value instance variable to a value between 0.0 and 1.0 to 
control the speed. These techniques are shown in the motor_demo.py 
code. You can also use pwm. pulse() to pulse the motor on and off. 


>STEP 06 
Use voice control 
Now that we’ve seen how to control the motor using GPIO Zero, it is time 
to integrate it with the Cloud Speech API. Push the button on your Voice 
HAT board and say “motor on” to start the motor running; push the 
button again and say “motor off” to stop it 

You can add more motors to your ATY Projects kit using the four rows 
of Drivers on the Voice HAT board. These can be used to build robots and 
other motion projects. Discover more project ideas for your Voice Kit at 
the AIY Projects forum (magpi.cc/2wuTMMW). We hope you’ve enjoyed 
this guide and build many great things with your ATY Projects Voice Kit. 
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[ AlY PROJECTS ] 


motor _demo.py | ; ; i 
#!/usr/bin/env python3 
import aiy.audio Z 
import aiy.cloudspeech 


import aiy.voicehat 
from gpiozero import PWMOutputDevice 


def main(): 
recognizer = aiy.cloudspeech.get_ recognizer() 
recognizer.expect_phrase('on') 
recognizer.expect_phrase('off' ) 


button = aiy.voicehat.get button() 
aiy.audio.get recorder().start() 


pwm = PWMOutputDevice(4) 


while True: 
print('Press the button and speak’ ) 
button.wait_for_press() 
print('Listening...') 
text = recognizer.recognize() 
if text is None: 
print('Sorry, I did not hear you.') 
else: 
print('You said "', text, '"") 
if ‘on' in text: 
print('Turning motor on') 
pwm.on() 
elit Off an text: 
print('Turning motor off') 
pwm.off() 


if name == '_main_': 
main() 
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